Cumulative and Averaging Fission of Beliefs 



Audun J0sang 

UniK, University of Oslo 
Norway 
josang @ unik.no 



Abstract 

Belief fusion is the principle of com- 
bining separate beliefs or bodies of 
evidence originating from different 
sources. Depending on the situation 
to be modelled, different belief fusion 
methods can be applied. Cumulative 
and averaging belief fusion is defined 
for fusing opinions in subjective logic, 
and for fusing belief functions in gen- 
eral. The principle of fission is the 
opposite of fusion, namely to elimi- 
nate the contribution of a specific be- 
lief from an already fused belief, with 
the purpose of deriving the remaining 
belief. This paper describes fission 
of cumulative belief as well as fission 
of averaging belief in subjective logic. 
These operators can for example be ap- 
plied to belief revision in Bayesian be- 
lief networks, where the belief contri- 
bution of a given evidence source can 
be determined as a function of a given 
fused belief and its other contributing 
behefs. 

Keywords: Fusion, fission, subjective 
logic, belief, uncertainty 

1 Introduction 

Subjective logic is a type of probabilistic logic 
that explicitly takes uncertainty and belief own- 
ership into account. In general, subjective logic 
is suitable for modeling and analysing situations 
involving uncertainty and incomplete knowledge 



mill. For example, it can be used for modeling 
trust networks {6} and for analysing Bayesian net- 
works |[5l . 

Arguments in subjective logic are subjective opin- 
ions about propositions. The opinion space is 
a subset of the belief function space used in 
Dempster-Shafer belief theory. The term be- 
lief will be used interchangeably with opinions 
throughout this paper. A binomial opinion ap- 
plies to a single proposition, and can be rep- 
resented as a Beta distribution. A multinomial 
opinion applies to a collection of propositions, 
and can be represented as a Dirichlet distribu- 
tion. Through the correspondence between opin- 
ions and Beta/Dirichlet distributions, subjective 
logic provides an algebra for these functions. 

The two types of fusion defined for subjective 
logic are cumulative fusion and averaging fusion 
HI . Situations that can be modelled with the cu- 
mulative operator are for example when fusing 
beliefs of two observers who have assessed sepa- 
rate and independent evidence, such as when they 
have observed the outcomes of a given process 
over two separate non-overlapping time periods. 
Situations that can be modelled with the averag- 
ing operator are for example when fusing beliefs 
of two observers who have assessed the same ev- 
idence and possibly interpreted it differently. 

Dempster's rule also represents a method com- 
monly applied for fusing beliefs. However, it is 
not used in subjective logic and will not be dis- 
cussed here. 

There are situations where it is useful to split a 
fused belief in its contributing belief components, 
and this process is called belief fission. This re- 



quires the already fused belief and one of its con- 
tributing belief components as input, and will pro- 
duce the remaining contributing belief component 
as output. Fission is basically the opposite of fu- 
sion, and the formal expressions for fission can be 
derived by rearranging the expressions for fusion. 
This will be described in the following sections. 

2 Fundamentals of Subjective Logic 

Subjective opinions express subjective beliefs 
about the truth of propositions with degrees of un- 
certainty, and can indicate subjective behef own- 
ership whenever required. An opinion is usually 
denoted as uj^ where A is the subject, also called 
the belief owner, and x is the proposition to which 
the opinion applies. An alternative notation is 
io{A : x). The proposition x is assumed to be- 
long to a frame of discernment (also called state 
space) e.g. denoted as X, but the frame is usually 
not included in the opinion notation. The propo- 
sitions of a frame are normally assumed to be ex- 
haustive and mutually disjoint, and subjects are 
assumed to have a common semantic interpreta- 
tion of propositions. The subject, the proposition 
and its frame are attributes of an opinion. Indi- 
cation of subjective belief ownership is normally 
omitted whenever irrelevant. 

2.1 Binomial Opinions 

Let X be a proposition. Entity ^'s binomial opin- 
ion about the truth of a x is the ordered quadruple 
uj^ = {b, d, u, a) with the components: 

b: belief that the proposition is true 
d: disbelief that the proposition is true 

(i.e. the belief that the proposition is false) 
u: uncertainty about the probability of x 

(i.e. the amount of uncommitted belief) 
a: base rate of x 

(i.e. probability of x in the absence of belief) 

These components satisfy: 

b, d, u, ae [0,1] (1) 

and b + d + u = l (2) 

The characteristics of various opinion classes are 
hsted below. An opinion where: 



6 = 1: is equivalent to binary logic TRUE, 
d = 1: is equivalent to binary logic FALSE, 
6 + d = 1: is equivalent to a probability, 
< (fe + d) < 1: expresses uncertainty, and 
b + d = 0: is vacuous (i.e. totally uncertain). 

The probability expectation value of a binomial 
opinion is: 

p{ujx) = bx + a^u^ . (3) 

The expression of Eq.(|3]l is equivalent to the pig- 
nistic probability in traditional belief function 
theory [10], and is based on the principle that 
the belief mass assigned to the whole frame is 
split equally among the singletons of the frame. 
In Eq.© the base rate Qx must be interpreted in 
the sense that the relative proportion of singletons 
contained in x is equal to a^. 

Binomial opinions can be represented on an equi- 
lateral triangle as shown in Fig [T] below. A point 
inside the triangle represents a (6, d, u) triple. The 
b,d,u-axes run from one edge to the opposite ver- 
tex indicated by the Belief, Disbelief or Uncer- 
tainty label. For example, a strong positive opin- 
ion is represented by a point towards the bottom 
right Belief vertex. The base rate, also called rel- 
ative atomicity, is shown as a red pointer along 
the probability base line, and the probability ex- 
pectation, E, is formed by projecting the opin- 
ion onto the base, parallel to the base rate pro- 
jector line. As an example, the opinion = 
(0.4, 0.1, 0.5, 0.6) is shown on the figure. 



Uncertainty 



Disbelief 




Probability base line 



Figure 1 : Opinion triangle with example opinion 

Uncertainty about probability values can be inter- 
preted as ignorance, or second order uncertainty 



about the first order probabilities. In this pa- 
per, the term "uncertainty" will be used in the 
sense of "uncertainty about the probability val- 
ues". A probabilistic logic based on belief theory 
therefore represents a generalisation of traditional 
probabilistic logic. 

2.2 Multinomial Opinions 

Let X be a frame, i.e. a set of exhaustive and mu- 
tually disjoint propositions xi. Entity yl's multi- 
nomial opinion over X is the composite func- 
tion ujj^ = (b,u,a), where 6 is a vector of belief 
masses over the propositions of X, u is the uncer- 
tainty mass, and a is a vector of base rate values 
over the propositions of X. These components 
satisfy: 

bixi),u,aixi) G [0,1], yxi G X (4) 
u+Y^ h{x{) = 1 (5) 

a{xi) = 1 (6) 



3 Fusion of Multinomial Opinions 

In many situations there will be multiple sources 
of evidence, and fusion can be used to combine 
evidence from different sources. 

In order to provide an interpretation of fusion in 
subjective logic it is useful to consider a process 
that is observed by two sensors. A distinction can 
be made between two cases. 

1 . The two sensors observe the process during 
disjoint time periods. In this case the ob- 
servations are independent, and it is natural 
to simply add the observations from the two 
sensors, and the resulting fusion is called cu- 
mulative fusion. 

2. The two sensors observe the process during 
the same time period. In this case the ob- 
servations are dependent, and it is natural to 
take the average of the observations by the 
two sensors, and the resulting fusion is called 
averaging fusion. 



Visualising multinomial opinions is not trivial. 
Trinomial opinions can be visualised as points in- 
side a triangular pyramid as shown in FiglH but 
the 2D aspect of printed paper and computer mon- 
itors make this impractical in general. 



u 




Figure 2: Opinion pyramid with example trino- 
mial opinion 

Opinions with dimensions larger than trinomial 
do not lend themselves to traditional visualisa- 
tion. 



3.1 Cumulative Fusion 

Assume a frame X containing k elements. As- 
sume two observers A and B who have indepen- 
dent opinions over the frame X. This cane for ex- 
ample result from having observed the outcomes 
of a process over two separate time periods. 

Let the two observers' respective opinions be 
expressed as oj^ = {b^,u^,ax) and uj^ = 

The cumulative fusion of these two bodies of evi- 
dence is denoted as ojA o Bx = uJx ® ^x- 
symbol "o" denotes the fusion of two observers A 
and B into a single imaginary observer denoted as 
Ao B. The mathematical expressions for cumu- 
lative fusion is described below. 

Theorem 1 The Cumulative Fusion Operator 

Let Lo^ <^nd uj^ be opinions respectively held 
by agents A and B over the same frame X = 
{xi I i = 1, • • • , A;}. Let ujjf^ be the opinion 



such that: 
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Let the two observers' respective opinions be 



expressed as uj^ 

ib^x,^ 



and uj^ 



The averaging fusion of these two bodies of ev- 



idence is denoted as ujAoB 



X = t^x®.^ 



B 
X- 



The 



symbol "o" denotes the averaging fusion of two 
observers A and B into a single imaginary ob- 
server denoted as AoB. The mathematical ex- 
pressions for averaging fusion is described below. 

Theorem 2 The Averaging Fusion Operator 

Let ujx cind ll>x opinions respectively held 
by agents A and B over the same frame X = 
{xi I i = 1, • • • , fc}. Let uJx~^ be the opinion 
such that: 



Then called the cumulatively fused opin- 

ion ofuJx and u>x> representing the combination 
of independent opinions of A and B. By using the 
symbol '© ' to designate this belief operator, we 



define ujjf^ 



ujx ffi ^x- 



The cumulative fusion operator is equivalent to 
a posteriori updating of Dirichlet distributions. 
Its proof and derivation is based on the bijective 
mapping between multinomial opinions and and 
an augmented representation of the Dirichlet dis- 
tribution [4]. 

It can be verified that the cumulative fusion 
operator is commutative, associative and non- 
idempotent. In Case II of Theorem [TJ the asso- 
ciativity depends on the preservation of relative 
weights of intermediate results, which requires 
the additional weight variable 7. In this case, the 
cumulative operator is equivalent to the weighted 
average of probabilities. 

The cumulative fusion operator represents a gen- 
eralisation of the consensus operator ||3l |2l which 
emerges directly from Theorem [T] by assuming a 
binary frame. 

3.2 Averaging Fusion 

Assume a frame X containing k elements. As- 
sume two observers A and B who have dependent 
opinions over the frame X. This can for example 
result from observing the outcomes of the process 
over the same time periods. 



Case I: For 
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where 7 



lim 



'X 



''X 



''X 



Then 00^^ is called the averaged opinion ofu^x 
and 00 X, representing the combination of the de- 
pendent opinions of A and B. By using the sym- 
bol '© ' to designate this belief operator, we define 



AoB 



UJx®.^ 



The averaging operator is equivalent to averaging 
the evidence of Dirichlet distributions. Its proof 
derivation is based on the bijective mapping be- 
tween multinomial opinions and an augmented 
representation of Dirichlet distributions 13. 

It can be verified that the averaging fusion opera- 
tor is commutative and idempotent, but not asso- 
ciative. 



The averaging fusion operator represents a gener- 
alisation of the consensus operator for dependent 
opinions defined in {Jj. 



4 Fission of Multinomial Opinions 



The principle of belief fission is the opposite to 
belief fusion. This section describes the fission 
operators corresponding to the cumulative and av- 
eraging fusion operators described in the previous 
section. 



4.1 Cumulative Fission 
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Then called the cumulatively fissioned 

opinion of u)^ and uj^, representing the result of 
eliminating the opinions of B from that of C. By 
using the symbol 'Q' to designate this belief op- 



(12) 



erator, we define uj^ 



CoB 



B 



Assume a frame X containing k elements. As- 
sume two observers A and B who have observed 
the outcomes of a process over two separate time 
periods. Assume that the observers beliefs have 
been cumulatively fused into uj 



AoB 
X 



(5^,u^,a^), and assume that entity B's con- 
tributing opinion 



' > ) known. 



The cumulative fission of these two bodies of ev- 



idence is denoted as u>x^^ 



UJ 



X 



B 
X' 



which represents entity A's contributing opinion. 
The mathematical expressions for cumulative fis- 
sion is described below. 



Cumulative fission is the inverse of cumulative 
fusion. Its proof and derivation is based on re- 
arranging the mathematical expressions of Theo- 
rem [U 

It can be verified that the cumulative rule 
is non-commutative, non-associative and non- 
idempotent. In Case II of Theorem |3l the fission 
rule is equivalent to the weighted subtraction of 
probabihties. 

4.2 Averaging Fission 

Assume a frame X containing k elements. As- 
sume two observers A and B who have observed 
the same outcomes of a process over the same 
time period. Assume that the observers beliefs 



Theorem 3 The Cumulative Fission Operator ^^^^ ^^^^ averagely fused into u;^ 
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Let uj'^ 
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X 



be the cumulatively fused opin- 



ion of uj^ and the unknown opinion ujj^ over the 



(6^,tt^,a^), and assume that entity B's con- 
tributing opinion uj^ = (6^, u^, a^) is known. 



frame X = {xi | i = 1, • • • ,/(;}. Let uj 
be the opinion such that: 



UJ 



CoB 
X 



The averaging fission of these two bodies of ev- 

CoB Cr^-, B 

^X~ = ^X^^X^ 



idence is denoted as uj^ 



which represents entity ^'s contributing opinion. 
The mathematical expressions for averaging fis- 
sion is described below. 
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Theorem 4 The Averaging Fission Operator 



Let uj^ = ujjf^ be the fused average opinion of 
^^^^ u>x Cind the unknown opinion u>x over the frame 
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r/ien a;^- is called the average fissioned opinion 
ofu)'^ andoj^, representing the result of eliminat- 
ing the opinions of B from that ofC. By using the 
symbol 'Q ' to designate this belief operator, we 



, n C^B 

define uj-^- 
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Averaging fission is the inverse of averaging fu- 
sion. Its proof and derivation is based on rear- 
ranging the mathematical expressions of Theo- 
rem |2] 

It can be verified that the averaging fission op- 
erator is idempotent, non-commutative and non- 
associative. 

5 Examples 

5.1 Simple Belief Fission 

Assume that A has an unknown opinion about x. 
Let i?'s opinion and the cumulatively fused opin- 
ion between A's and i?'s opinions be know as: 



AoB 



(0.90, 0.05, 0.05, i; 



f = (0.70, 0.10, 0.20, i)and 



respectively. Using the cumulative fission opera- 
tor it is possible to derive yl's opinion. This situ- 
ation is illustrated in FiglS] 



Figure 3: Principle of belief fission 



By inserting the opinions values into Eq.(|7]) the 
contributing opinion from A can be derived as 

oj^ = (0.93, 0.03, 0.06, ^) 

5.2 Inverse Reasoning in Bayesian Networks 

Bayesian belief networks represent models of 
conditional relationships between propositions of 
interest. Subjective logic provides operators for 
conditional deduction HI and conditional abduc- 
tion |j9j| which allows reasoning to take place in 
either direction along a conditional edge. FigS] 
shows a simple Bayesian belief network where x 
and y are parent evidence nodes and z is the child 
node. 



Node X 
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Figure 4: Bayesian network with belief fusion 



In order to derive the deduced opinions uJz\\x and 
ujy\\„ using the deduction operator, the opinions 



\y 



ujr and uj. 



'z\x' 



y, as well as the conditional opinions 
ujz\x, ^z\y and iOz\y are needed. Assuming 



that the contributions of 



UJ, 



and 



are inde- 



pendent, they can be fused with the cumulative 
fusion operator to produce the derived opinion 

'^z\\{x,y)- 

Belief revision based on the fission operator can 
be useful in case a very certain opinion about z 
has been determined from other sources, and it is 
in conflict with the opinion derived through the 
Bayesian network. In that case, the reasoning can 
be applied in the inverse direction using the fis- 
sion operator to revise the opinions about x and y 
or about the conditional relationships z\x and z\y. 



Opinion ownership in the form of a superscript 
to the opinions is not expressed in this example. 
It can be assumed that the analyst derives input 
opinion values as a function of evidence collected 
from different sources. The origin of the opin- 
ions are therefore implicitly represented as the ev- 
idence sources in this model. 

6 Conclusion 

The principle of belief fusion is used in numerous 
applications. The opposite principle of belief fis- 
sion is less commonly used. However, there are 
situations where fission can be useful. In this pa- 
per we have described the fission operators cor- 
responding to cumulative and averaging fusion in 
subjective logic. The derivation of the fission op- 
erators are based on rearranging the expressions 
for the corresponding fusion operators. 
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